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@ Data message storage and transmission using a videophone and a smart card. 



(57) A smart card, a non-passive, secure, microp- 
rocessor based data storage medium, is used 
for the storage of a plurality of data messages 
and is read by a video telephone tenminal 
(F1G.1) equipped with a smart card reader (90) 
to provide transmission of a data message (on 
TEL LINE), comprising video image data, either 
in still frame or full motion format, to a remote 
video telephone terminal. The use of the smart 
card for storage of a data message provkles a 
secure, transportable message that is available 
for transmission from any video telephone ter- 
minal having smart card reading capability. 
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FIELD OF THE INVENTION 

This invention relates to the use of a device, hav- 
ing its own microprocessor, memory (comprising a 
video image) and input/output (I/O) circuitry, as a 
data storage medium for use with video telephone 
units having compatible data storage reading capabil- 
ity. 

BACKGROUND OF THE INVENTION 

Smart cards are non-passive data storage devic- 
es which comprise a microprocessor, memory and I/O 
circuitry. Smart cards are generally used when a se- 
cure and portable means to store data is desired. 
There are "contact less** smart cards which do not re- 
quire physical contact to transfer data between the 
card and a card reader and there are smart cards 
which have electrical contacts to facilitate such data 
transfer. Prior art United States Patent Number 
4.480,178 describes a contactless smart card and 
United States Patent Number 5.120,939 describes 
the security which smart cards provide when used as 
data memory devices. 

Video telephones are used in communication 
systems to provide a two-way audio and video conrv 
munications link, tn general, a video telephone (vid- 
eophone) uses a video camera in conjunction with a 
video display unit, a hands-free speakerphone, and a 
telephone interface. United States Patent No. 
4,715,059 describes a microprocessor based video- 
phone wherein the defined hardware is suited for gen- 
eral use in a videophone communications network. A 
problem arises when a userof a videophone does not 
wish to have his/her video image sent to another ter- 
minal, for instance when one is just waking. Addition- 
ally, the normal image transmission process be- 
comes problematic when a party attempts to locate 
an illustration before the video camera of his/her vid- 
eophone, during a conversation with another party, in 
an effort to center the image which is subsequently 
presented. 

SUMMARY OF THE INVENTION 

The present invention is directed to the use of a 
video telephone unit equipped with a smart card read- 
er which accepts a smart card having data comprising 
a video image thereon. A plurality of vkieo image data 
(data messages), either in still frame or full motion 
format, are stored on the smalt, secure and portable 
smart card. The plurality of user defined data mes- 
sages may then be presented to another videophone 
terminal at any time and for any duration pursuant to 
the user's discretion. The data messages are trans- 
ferred to the smart card through any number of tech- 
niques, with the use of a camera and related hardware 
of the user's videophone being preferred. 



DESCRIPTION OF THE DRAWING 

The invention can be better understood when 
considered with the following drawings wherein: 

5 FIGURE 1 is a hardware block diagram of the pre- 

ferred video telephone employing a smart card 
reader of the present invention; 
FIGURE 2 is a block diagram of a smart card of 
the present inventton; 

10 FIGURE 3 is a software flow diagram showing 

the steps required to generate and store a data 
message on a smart card of the present inven- 
tion; and 

FIGURE 4 is a software flow diagram showing 
15 the steps required to retrieve the data message 

from the smart card and transmit the data mes- 
sage of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
20 EMBODIMENT 

FIGURE 1 shows a block diagram of a video- 
phone comprising a microprocessor 48. TV camera 
32. CRT display 38. modem 42. matrix switch 44 and 

25 telephone interface device 46. The TV camera 32 is 
used to capture video image data of the telephone 
user. The video image data from camera 32 are fed 
to an image control processing (ICP) circuit 34. ICP 
circuit 34 is a standard video display processor with 

30 additional circuitry for digitizing the video image data. 
The video display processor portion contains the vid- 
eo sync generator and a system timing circuit for gen- 
erating ali the system clocks. Processing circuit 34 
digitizes the video data from camera 32 and stores 

35 the resultant data in dynamic RAM 36. 

Processing circuit 34 also retrieves the data from 
RAM 36 and converts the data into analog form by 
means of a digital to analog (D/A) converter in circuit 
34. The analog values are then fed to a cathode ray 

40 tube (CRT) display 38 to display the video image. 
Processing circuit 34 additionally transfers data from 
RAM 36 to a microprocessor bus 40 from which it is 
fed to a video optimized modem 42. The modem 42 
operates to modulate a carrier signal with the video 

45 image data and feed the signal through a matrix 
switch 44 to a telephone interface circuit 46 for trans- 
mission to a remote videophone via the telephone 
line. 

The operation of the vkjeophone is controlled by 
so a microprocessor unit 48 which includes a clock 50, a 
static RAM 52, a ROM 54. a central processing unit 
(CPU) 56. and input/output ports 58. The micropro- 
cessor 48 is powered by a power supply 60 which is 
fed by the 115 volt A/C line voltage 62 with a battery 
55 backup 64. In order to conserve battery power, the 
power supply is actuated by a wake up circuit 66. The 
wake up circuit 66 is controlled by a keypad 68 on the 
videophone. If line power is used, the wake up circuit 



3 



EP0 683 613 A2 



4 



66 is automatically bypassed. 

The videophone also includes normal telephone 
audio circuits for transmission of voices including a 
handset microphone 70 and a handset speaker 72 as 
well as a speaker phone microphone 74 and a speak- 5 
er phone speaker 76. The microphones and speakers 
70, 72. 74, and 76 are coupled through an analog cir- 
cuit 78 to a matrix switch 44 for connection through 
the interface 46 to the telephone line. 

The matrix switch 44 is under the control of the io 
microprocessor unit 48 and provides appropriate 
paths for signals to and from the interface circuit 46, 
modem 42, and analog circuit 78. The interface circuit 
46 includes a duplexer, a programmable line impe- 
dance matching network, a delay equalizer, a ring de- is 
tect circuit, a line protection circuit, a loop current cir- 
cuit and a hook switch relay. 

During operation, the analog circuit 78 receives 
audio signals from the handset and speaker phone 
microphones 70, 74 and amplifies these signals. The 20 
audio signals are fed through the matrix switch 44 and 
interface circuit 46 and then transmitted, via the tel- 
ephone line, to the remote terminal. The analog circuit 
78 also amplifies audio information received from a 
remote user and applies the amplified signals to the 25 
handset speaker 72 or speaker phone speaker 76. 

The microprocessor unit 48 is also used to ex- 
pand the capabilities of the videophone. Astatic RAM 
52 is used to store directory information or other data 
utilized by a program stored in the program ROM 54. 30 
The microprocessor unit 48 further enables the video- 
phone to utilize either pulse or tone dialing. A battery 
64 ensures that information in static RAM 52 is re- 
tained when A/C power is not applied. The ICP circuit 
34 operates to process data from the microprocessor 35 
unit 48 and display such data as graphics or alphanu- 
merics on the CRT 38. 

A smart card reader 90 is coupled via a digital ser- 
ial interface 92 to the I/O port 58. The smart card read- 
er 90 comprises a data I/O interface (not shown) 40 
which is coupled to the data I/O interface 106 of the 
smart card when inserted therein. Thus the active 
functions and memory data of the smart card 108 are 
accessible to the videophone microprocessor 48. 
Similarly, the active functions and memory data of 45 
the videophone microprocessor 48 are accessible to 
the smart card 1 08. 

FIGURE 2 shows a block diagram of a smart card 
108 suitable for use in the present inventton. The 
smart card has a microprocessor 1 04, a power supply so 
100, an EEPROM memory 102 and a data I/O inter- 
face 106. 

The microprocessor 104 is used in providing ac- 
tive functions on the smart card 108 independent of 
outside control, making the smart card 108 a stand 55 
alone data processing unit capable of selectively tinrv 
iting access thereto. The power supply 100 provides 
a rectified DC voltage which biases the snnartcard cir- 



cuitry and the EEPROM memory 1 02 is used to store 
data generated by the microprocessor 104 or input 
through the data I/O interface 106. 

A preferred style of data I/O interface, for the 
smart card 108 and the smart card reader 90. is de- 
scribed in detail in United States Patent No. 
4.480,178 wherein the data I/O interface 106 utilizes 
an autonrtatic tuning circuit to insure continuous max- 
imum transfer of energy from the smart card reader 
90 to the snnart card 108 via a capacitive coupling ar- 
rangement. This arrangement comprises metallic 
plates with outer dielectric surfaces on the snrtart card 
1 08 and the smart card reader 90 which are formed 
when the smart card 108 is inserted in the snnart card 
reader 90. Thus the interface between the smart card 
1 08 and the smart card reader 90 does not require the 
physical contact of conductive materials to fecilitate 
the transfer of data therebetween. In the transfer of 
energy to the smart card 1 08. the reader 90 generates 
a high frequency signal which transfers the energy 
through the contactless, capacitlvely coupled surfac- 
es. 

In general, the smart card 108 is the size of a 
standard credit card and resembles same. Several 
companies are developing and nnanufacturing smart 
cards including AT&T of the United States and GEM 
of the United Kingdom. Both the AT&T "EXPEDITOR" 
smart card and the '*5B" smart card reader are of the 
contactless variety and are well suited for use in the 
present invention. 

The mutual access of function plus memory be- 
tween the smart card 108 and the microprocessor 46 
of the video telephone facilitates the secure transfer 
and storage of data messages which are used to greet 
or inform various parties using video telephones. 

A data message is any user defined message 
which has been at least partially stored in the EE- 
PROM 102 of the smart card 1 08. The data message, 
or a portion thereof, is stored in the EEPROM 102 of 
the smart card 108 using any of a plurality of methods. 
The preferred method uses the TV camera 68 of the 
video telephone to capture video image data, the 
speakerphone speaker^76 to capture audio track data 
and the RAM 52 and/or 36 to store sanrte. The CPU 
56 then transfers the data message, comprised of the 
video innage data and the audio track data (multi-me- 
dia data message), to the smart card 108 through the 
I/O port 58 and the smart card reader 90. 

It is noted that the format of the video image por- 
tion of the data message can be a still innage or a full 
motion image depending on the capabilities of the 
hardware and the desires of the user. The presently 
described emt>odiment comprises a hardware system 
which can support either format of video image. 

FIGURE 3 shows a software flow diagram which 
defines the process by which a multi-media data mes- 
sage may be generated using the TV camera 32 and 
speakerphone speaker 76 of the video telephone and 
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stored on the smart card 108. A user initiates a data 
message generation subroutine of the main software 
program of the videophone microprocessor 48 by de- 
pressing a special button designated for data mes- 
sage generation. 5 

Once the data message generation subroutine is 
initiated, the microprocessor ensures that a smart 
card 1 08 is inserted in the smart card reader 90. A ver- 
ification routine is executed (prompting the user for a 
password or PIN number if necessary) to ensure the io 
security of the data stored on the smart card 108. If 
the smart card 108 is being used to store a data mes- 
sage for the first time (no previous data message file 
exists), the microprocessor 48 of the videophone and 
the microprocessor 1 04 of the smart card 1 08 will ere- is 
ate a data message file directory and data message 
file(s) which will initially be empty. 

When a still frame video image data message is 
desired, only one data message file is created. How- 
ever, when a full motion video image data message 20 
is desired, several data message files are generated 
(or sections of one data message file are generated) 
which store the full motion data message. 

The data message generation subroutine next 
prompts the user to locate the desired image or se- 25 
quence of images in front of the TV camera 32 of the 
videophone and the audio source in front of the 
speakerphone speaker 76. The captured video image 
data and audio track data are temporarily stored in 
RAM 52 and/or 36 of the videophone. 30 

When the storage capability of the EEPROM 
memory 1 02 of the smart card 1 08 is not large enough 
to store the raw data of the captured video image data 
and audio track data stored in RAM 52 and/or 36 of 
the videophone, a video image data processing algo- 35 
rithm must be employed. A preferred processing algo- 
rithm for still frame data messages is Joint Photo- 
graphic Experts Group (JPEG) which compresses the 
video image data with a resultant decrease in the 
quantity of memory required to store a data message 40 
on the smart card 108. JPEG is a well known techni- 
que which generates a data sequence, representing 
a particular video image, which may be arbitrarily 
compressed as video image quality is sacrificed. Mo- 
tion Picture Experts Group (MPEG) is a preferred 45 
processing algorithm for full motion data messages. 

The video image data and audio track data are 
written to the EEPROM memory 102 of the smart card 
1 08 through the I/O port 58 and the smart card reader 
90 and remain secure on the smart card 108 as long so 
as the user wishes. Additionally, the data message is 
portable to any videophone which has a smart card 
reader thus facilitating the presentatton of a person- 
alized data message, in accordance with the smart 
card 108, regardless of the location or ownership of 55 
the videophone. 

When the use of the smart card 1 08 is desired, it 
is inserted into the smart card reader 90. and the data 



message is transmitted, via the telephone line, to a 
remote videophone terminal for presentation. FIG- 
URE 4 shows a software flow diagram defining the 
process by which a data message may be retrieved 
from the snnart card 108 and transmitted to the vid- 
eophone of another user. The data message retrieval 
and transmissk)n is user initiated or automatic de- 
pending oh the pre-defined program of the video- 
phone unit accepting the smart card 108. 

Once the retrieval subroutine is initiated, an acti- 
vation/verification routine, similar to the aforemen- 
tioned verification routine of the data message gen- 
eration subroutine, is started. The contents of the 
data message f ile(s) are read into RAM 52 and/or 36 
of the videophone through the smart card reader 90 
and the I/O port 58. 

When the data message is of the still frame for- 
mat, only the one data message file is retrieved. The 
vkjeo image data, of the data message file, is expand- 
ed according to the JPEG data processing algorithm 
and then transferred to the modem 42. The vkjeo inrv 
age data are transmitted by the telephone interface 
device 46 to a remote videophone for display, via the 
telephone line. Coincidently or subsequently, the au- 
dio track data are transferred to the analog circuit 78 
and transmitted, via the telephone line, for presenta- 
tion from the remote videophone. The data message 
file is re-transmitted until the user manually signals 
a completk>n of data message transmission or until 
the main program of the videophone automatically in- 
terrupts the data message transmission for live data 
transmission. 

For full motion data message transmission, all 
pertinent data message files (or sections of a single 
file) are expanded using the JPEG algorithm and, 
rather than retransmitting the same data message, 
the next data message file (or section of a single file) 
is transferred from RAM 52 and/or 36 to the modem 
42. The video image data are transmitted by the tel- 
ephone interface 46, via the telephone line, to the re- 
mote videophone. Coincidently or subsequently, the 
audio track data are transferred from the RAM 52 
and/or 36 to the analog circuit 78 and transmitted, via 
the telephone line, to the remote videophone. 

The sequencing of the images produced by the 
transmission of the video image data and their sub- 
sequent display produces the appearance of full vid- 
eo motion. The sequence of video image data and au- 
dio track data are then re-transmitted until the user 
manually signals the completk>n of data message 
transmission or the main program of the videophone 
automatically interrupts the data message transmis- 
sk»n for live data transmission. Control then returns 
to the main program of the videophone for further in- 
struction. 

The flexibility which the microprocessor 48 pro- 
vkjes may lead one, skilled in the art, to add several 
functions to the invention described heretofore. For 
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example, since available memory is the only limit to 
the number of distinct data messages which may be 
stored on the smart card 108, the program may 
prompt the user to select any of the plurality of resi- 
dent data messages for transmission to the renrKJte 
videophone. The program may also automatically or 
manually transmit a sequence of user-defined data 
messages which reside, at least in part, on the smart 
card 108. Additionally, the program may provide for 
overriding any functions of the user's choice such as 
the automatic interruption of data message re-trans- 
mrsston. 

Another adaptation of the present invention is the 
use of the data message, comprising video image 
data, stored on the smart card 108 as an outgoing 
greeting message of a videophone answering ma- 
chine. Videophone answering machines are known in 
the art to provide a means for recording a video image 
and audio track of a calling party and subsequent re- 
production of the video image and audio track when 
requested by the called party. The present invention 
may be adapted to produce an outgoing greeting by 
triggering the transmission of the data message(s) af- 
ter a telephone interface device of the videophone an- 
swering machine has detected a connection between 
the videophone of the calling party and the video- 
phone answering machine of the called party. After 
the outgoing message has been transmitted, the vid- 
eophone answering machine records the incoming 
message of the calling party. United States Patent 
Number 5,046,079 describes a videophone answer- 
ing machine which is suited for adaptation of the pres- 
ent invention. 

Thus, in accordance with this invention, a small, 
secure and portable means of storing at least one 
data message, either of still frame or full motion for- 
mat, is used to transfer a user's data message to a 
videophone terminal to present a personalized data 
message to a renrx)te videophone. 

The foregoing description of the preferred env 
bodiment of the invention has been presented for the 
purposes of illustration and description. It is not in- 
tended to be exhaustive or to limit the invention to the 
precise form disclosed. Modifications and variations 
are possible in light of the above teaching. It is intend- 
ed that the scope of the invention be not limited by this 
detailed description, but rather by the claims append- 
ed hereto. 

The following patents are hereby incorporated 
into this patent specification by reference; 
United States Patent Number 4,480, 178; 
United States Patent Number 4,71 5,059; and 
United States Patent Number 5,120,939. 



Claims 

1 . A process for remotely displaying a data message 



on a remote microprocessor teased video commu- 
nications device comprising the steps of: 

generating a data nrtessage comprising a 
video image; 

5 storing at least a portion of said data mes- 

sage as a stored data message on a microproces- 
sor based data storage device; 

retrieving said stored data message using 
data storage reading means associated with a 
10 first microprocessor based video communica- 

tions device; 

transmitting said data message using said 
first microprocessor based video communica- 
tions device to said remote microprocessor 
15 based video communications device; and 

displaying said data message on said re- 
mote microprocessor based video communica- 
tions device. 

20 2. The process for remotely displaying a data mes- 
sage as defined in Claim 1, wherein said micro- 
processor based data storage device comprises: 
microprocessing means for controlling 
data transfer, providing data manipulation func- 
25 tions and providing security for said stored data 

message; 

data message memory means for storing 
the data message; and 

data I/O interface means for transferring 
30 said data message between a data storage de- 

vice reader and said microprocessor based data 
storage device. 

3. The process for remotely displaying a data mes- 
35 sage as defined in Claim 2, wherein said micro- 
processor based data storage device comprises 
a smart card. 

4. The process for remotely displaying a data mes- 
40 sage as defined in Claim 3. wherein said smart 

card comprises a contactless I/O interface 
means. 

5. The process for remotely displaying a data me»- 
45 sage as defined in Claim 1 , wherein sakj first mi- 
croprocessor based video comnuinicatlons de- 
vice comprises: 

microprocessor means for controlling data 
transfer and providing data manipulation func- 
50 tions; 

memory means for storing data; 
data storage reader means comprising I/O 
interface means for transferring at least a portion 
of said data message between the memory 
55 means of the first microprocessor based video 

communications device and said microprocessor 
based data storage device; 

communications interface means for 
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transmitting data to and receiving data from said 
remote microprocessor based video communica- 
tions device; and 

video image capturing means for captur- 
ing a video image for generation of said data mes- 
sage. 

6. The process for remotely displaying a data mes- 
sage as defined in Claim 5, wherein said commu- 
nications interface means of said first micropro- 
cessor based video communications device com- 
prises a telephone line interface circuit for provid- 
ing data transmission via a telephone line. 

7. The process for remotely displaying a data mes- 
sage as defined in Claim 5, wherein said first mi- 
croprocessor based video communications de- 
vice is comprised of a videophone comprising a 
smart card reader. 

8. The process for remotely displaying a data mes- 
sage as defined in Claim 1. wherein storing at 
least a portion of said data message further com- 
prises the steps of: 

initiating a data message generation rou- 
tine; 

creating at least one data message file in 
a data message mennory means of said first mi- 
croprocessor based data storage device; 

generating said data message; 

storing at least a portion of the data mes- 
sage in the memory means of said first micropro- 
cessor based video communications device; 

transferring at least a portion of the data 
message from said memory means of said first 
microprocessor based video communications de- 
vice to the I/O interface means of the first micro- 
processor based video communications device; 

transferring at least a portion of the data 
message from the I/O interface means of said 
first microprocessor based video communica- 
tions device to the I/O interface means of said mi- 
croprocessor based data storage device; and 

writing said data message in said data 
message menrwry means. 

9. The process for remotely displaying a data mes- 
sage as defined in Claim 8, wherein said process 
comprises the additional step of processing said 
data message using a data processing algorithm 
prior to transferring said data message to the I/O 
interface means of the first microprocessor 
based video communications device. 

10. The process for remotely displaying a data mes- 
sage as defined in Claim 1, wherein said micro- 
processor based data storage device comprises 
microprocessing means for controlling data 



transfer, providing data manipulation functions 
and providing security for said stored data mes- 
sage data message; memory means for storing 
the data message; and data I/O interface means 

5 for transferring said data message between a 

data storage device reader and said microproces- 
sor based data storage device, and wherein said 
first microprocessor based video communica- 
tions device comprises microprocessor means 

10 for controlling data transfer and providing data 

manipulation functions; memory means for stor- 
ing data; data storage reader means comprising 
I/O interface means for transferring at least a por- 
tion of said data message between the menrK)ry 

15 means of the first microprocessor based video 

communications device and said microprocessor 
based data storage device; communications in- 
terface means for transmitting data to and receiv- 
ing data from said remote microprocessor based 

20 video communications device; and video image 

generation means for generating a video image 
and generating said data message, said process 
further comprising the steps of: 

reading at least a portion of said data mes- 

25 sage from said microprocessor based data stor- 

age device using both I/O interface means of said 
microprocessor based data storage device and 
said data storage reader means of said first mi- 
croprocessor based video communications de- 

30 vice; 

storing said data message In said menrrary 
means of the first microprocessor based video 
communications device; 

transferring said data message to the 
35 communications interface means of the first mi- 

croprocessor based video communications de- 
vice; 

transmitting said data message to said re- 
mote microprocessor based video communica- 
40 tions device; and 

presenting said data message on said re- 
mote microprocessor based video communica- 
tions device. 

45 11. The process for remotely displaying a data mes- 
sage as defined in Claim 10, wherein said proc- 
ess comprises the additional step of processing 
said data message using a data processing algo- 
rithm prior to transferring said data message to 

so the communications interface means of the first 

microprocessor based video communications de- 
vice. 

12. The process for remotely displaying a data mes- 
55 sage as defined in Claim 9 or 11, wherein said 

data processing algorithm is JPEG. 

13. The process for remotely displaying a data mes- 
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18. The process for remotely displaying a data mes- 
sage as defined in Claim 1, wherein said process 
further comprises the step of automatically ter- 
minating the transmission of said data message 
after a predetermined period has elapsed. 
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sage as defined in Claim 9 or 11. wherein said 
data processing algorithm is MPEG. 

14. The process for remotely displaying a data mes- 
sage as defined in Claim 1 , wherein the first mi- 
croprocessor based video communications de- 
vice comprises a video camera and the step of 
generating said data message comprises using 
said video camera to capture a visual image. 

15. The process for remotely displaying a data mes- 
sage as defined in Claim 14, wherein the first mi- 
croprocessor based video communications de- 
vice comprises a microphone and the step of gen- 
erating said data message further comprises us- is 
ing said microphone to capture audio track data. 

16. The process for remotely displaying a data mes- 
sage as defined in Claim 1 , wherein said process 
further comprises the step of re-transmitting said 20 
data message to said remote microprocessor 
based video communications device at the end of 

the initial data message transmission. 

17. The process for remotely displaying a data mes- 25 
sage as defined in Claim 1 , wherein said process 
further comprises the step of manually terminat- 
ing the data message transmission by user Inter- 
vention. 
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